Extinction of oscillating populations.

Established populations often exhibit oscillations in their sizes that, in the deterministic theory, correspond to a limit cycle in the space of population sizes. If a population is isolated, the intrinsic stochasticity of elemental processes can ultimately bring it to extinction. Here we study extinction of oscillating populations in a stochastic version of the Rosenzweig-MacArthur predator-prey model. To this end we develop a WKB (Wentzel, Kramers and Brillouin) approximation to the master equation, employing the characteristic population size as the large parameter. Similar WKB theories have been developed previously in the context of population extinction from an attracting multipopulation fixed point. We evaluate the extinction rates and find the most probable paths to extinction from the limit cycle by applying Floquet theory to the dynamics of an effective four-dimensional WKB Hamiltonian. We show that the entropic barriers to extinction change in a nonanalytic way as the system passes through the Hopf bifurcation. We also study the subleading pre-exponential factors of the WKB approximation.